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Description 

Background of the Invention 

5 1. Field of the Invention 

[0001] This invention relates to the field of video processing and, in particular, to the processing of video, audio and 
data signals which are transmitted between computers. 

10 2. Background Art 

[0002] Video conferencing networks may be isochronous networks having a fixed bandwidth and a fixed delay. This 
permits transmitted video compressed at one end of a video conferencing network to arrive at the remote end of the 
network in a fixed fashion so that it can be smoothly decompressed and displayed. This also prevent a choppy repro- 
*5 duction. 

[0003] The problems caused by choppy video reproduction may not be very noticeable. However, when audio re- 
production is choppy, the results are unsatisfactory. The only isochronous network available at this time for avoiding 
this problem is the telephone system. 

[0004] In the publication of S.R. Ahuja et al. in "Sigois Bulletin", April 1990, vol. 11 , no. 2-3, Cambridge, USA (pages 
20 238-248) a desktop conferencing system for real-time computer-based conferences is disclosed, in which users may 
share data through their personal computers. 

[0005] The object of the invention is to provide an improved computer conferencing system and method which meets 
the drawbacks of conventional systems. 

[0006] This object is solved by a computer conferencing system, a conferencing device and a method with the fea- 
2S tures of claims 1, 8 and 10, respectively. Advantageous embodiments of the invention are defined in the dependent 
claims. 

[0007] The computer supported collaboration system of the invention as claimed includes in particular both video 
and audio data communications. The communication of video and audio data are simultaneous with the sharing of 
application programs, and their application program data, by way of a connection between computers. The connection 
30 between computers may be implemented in a number of ways. For example, the public telephone network may provide 
a connection between computers which are located in different locations, in a single country, or in locations in different 
countries. However, the inventive system is not limited to connections by way of public telephone networks. For example 
the connection may be a dedicated data connection between the computers. 

[0008] A video conference application program allows an initiating user to select a remote computer using the name 
35 of the destination user or using a corresponding identifier such as the telephone number of the destination user. A 
video conference may then be established with the destination user. The application program of the initiating user 
places a call to the selected remote computer. This may be performed using a CALL button that, when pressed, presents 
the initiating user with a listing of names and identifiers. If the remote computer is also running the video conference 
application program the initiating application program begins the video conference by transmitting compressed inter- 
40 leaved audio and video frames to the remote computer by way of the data connection. The remote computer also starts 
transmitting compressed interleaved audio and video frames. When each of the computers receives data the com- 
pressed data is decompressed and displayed or heard in the case of audio. 

[0009] Images of the users of the computer supported collaboration system may be displayed in a small window on 
their own displays in addition to being displayed at the other end of the system. This permits users to determine that 

45 the image received by the remote user is suitable for display. The remote user is preferably displayed in a larger window 
on each display in order to keep the focus of the users on the remote users. A HANGUP button may also be provided 
. for use when a video conference is in progress. This permits termination of the video conference. 
[0010] The sharing of application programs between the remote terminals and the sharing of their data in the com- 
puter supported collaboration system of the present invention may be performed using various data sharing embodi- 

so ments. A very general data sharing embodiment is an embodiment wherein mouse drivers and keyboard drivers are 
provided in order to: (1) send data from both the mouse and the keyboard to the remote computer operating system 
on the remote side of the network, as well as (2) send data to the operating system of the local computer. This em- 
bodiment permits any application program to be shared across the network even it it was not originally designed to be 
shared. 

55 [0011] An alternate data sharing embodiment is one wherein an application program is written in a manner which 
adapts it for data sharing during a video conference. In this data sharing embodiment each application program trans- 
mits its data to the remote application program in an appropriate manner. A further data sharing embodiment is one 
wherein the operating system of each of the computers allows application programs to cut and/or copy data into a 
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respective clipboard which is effectively shared by the two computers. The shared clipboard of each computer transmits 
this data to the shared clipboard of the remote computer. This permits any application which provides cut and/or copy 
capability to be shared using the computer supported collaboration system of the present invention. 

5 Brief Description of the Drawings 

[0012] Fig. 1 shows a block diagram representation of the computer supported collaboration system of the present 
invention. 

[0013] Fig. 2 shows a block diagram representation of a data sharing embodiment which may be implemented on 
10 the computer supported collaboration system of Fig 1 . 

[0014] Fig. 3 shows a block diagram representation of an alternate data sharing embodiment which may be imple- 
mented on the computer supported collaboration system of Fig. 1. 

[0015] Fig. 4 shows a block diagram representation of a further alternate data sharing embodiment which may be 
implemented on the computer supported collaboration system of Fig. 1 . 
15 [0016] Fig. 5 shows a block diagram of a video conference portion of the computer supported collaboration system 
of Fig. 1. 

Detailed Description of the Invention 

20 [0017] Referring now to Fig. 1, there is shown video conferencing system 100 wherein application programs 114, 
120 run simultaneously on personal computers 102, 104 and communicate with each other. The communication be- 
tween personal computers 102, 104, executing application programs 114, 120, is byway of videoconferencing network 
124. In this embodiment of the present invention a video teleconference is supported between personal computers 
102, 104 wherein the video images and the audio signals generated at the end of video conferencing system 100 

25 where personal computer 102 is disposed are captured in computer 102. The captured signals in personal computer 
102 are transmitted by way of video conferencing network 124 to personal computer 104. At personal computer 104 
the video captured by personal computer 102 is displayed and the audio is played out. 

[0018] Depending on the type of data sharing implemented on video conferencing system 1 00 application programs 
114, 120 may be designed for data sharing with a number of users or they may be completely independent of any 

30 previous data sharing capability. For example, applications programs 114, 120 may be Microsoft Excel. Using video 
conferencing system 100 application programs 114, 120 operating upon personal computers 102, 104 may share 
network resources. In conferencing system 100 the audio data streams as well as the video data streams of personal 
computers 102, 104 are multiplexed over bidirectional data transmission line 138. The operations and functions of 
application collaboration drivers 127, 129 are described herein below for a variety of data sharing embodiments. 

35 [0019] Referring now to Fig. 2, there is shown a block diagram flow representation of data sharing embodiment 200. 
Data sharing embodiment 200 may be implemented on the video conferencing system of the present invention using 
video conferencing network 224. Application program 214 of data sharing embodiment 200 may receive its input both 
from keyboard 216 and mouse device 230. The inputs from keyboard 216 and mouse device 230 are received and 
transmitted to application program 214 by way of keyboard driver 234 and mouse driver 231 respectively. Application 

40 program 220 may receive its input from both keyboard 222 and mouse device 228. The inputs from keyboard 222 and 
mouse device 228 are received and transmitted to application program 220 by way of keyboard driver 236 and mouse 
driver 232 respectively. Drivers 231, 234 apply input data directly to application program 214. Drivers 232, 236 apply 
input data directly to application program 220. 

[0020] In a typical configuration of data sharing embodiment 220, keyboards 21 6, 222 generate interrupts in response 
45 to a user depressing keys. In the preferred embodiment keyboard drivers 234, 236 handle these interrupts themselves 
in order to receive the information from keyboards 216, 222 and apply it to application programs 21 4, 220. Drivers 231 , 
234 may be software routines adapted toapply data to application program 214 by way of bidirectional data transmission 
lines 240, 242. In data conferencing system 200 drivers 231, 234 also apply keyboard data and mouse device data to 
data sharing driver 250. When data sharing driver 250 receives this data from bidirectional data transmission lines 
50 240, 242, it applies the received data to a remote computer by way of video conferencing network 224. 

[0021] Similar to the manner described with respect to drivers 231 , 234, drivers 232, 236 may be software routines 
adapted to apply data to an application program such as application program 220. Drivers 232, 236 apply this data to 
application program 220 by way of bidirectional data transmission lines 244, 246. The data applied to application 
program 220 is simultaneously applied to data sharing driver 260 by way of data transmission lines 244, 246. Data 
55 sharing driver 260 applies the data received by way of transmission lines 244, 246 to video conferencing network 224 
for transmission to a remote computer. For example, the data applied to network 224 by drivers 232, 236 may be 
received by data sharing driver 250 for use and display by application program 214 under the control of data sharing 
application 252. 
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[0022] Thus, input into either application program 214, 220 is shared with the other application program 214, 220 
within data sharing embodiment 200. In order to share data in this manner application program 214 and application 
program 220 should be the same revision of the same application. Additionally, the screen arrangement for the display 
of application programs 214, 220 should be exactly the same. For example, when working on a certain cell of a spread- 
5 sheet in one application program 214, 220 the screen should be set up the same way in the other application program 
214, 220 so that the same cell is modified by movements of mouse devices 228, 230. Even though application programs 
214, 220 are operating exactly in parallel in this manner, the fact that they are being shared is completely transparent 
to their operation and each operates as if the other is not operating. 

[0023] It is the operation of data sharing applications 252, 262 which permits the data sharing of data sharing em- 
10 bodiment 200. Data sharing applications 252, 262 control data sharing drivers 250, 260, respectively, by way of bidi- 
rectional data sharing control lines 251 , 261 . Under the control of data sharing drivers 250, 260 one application program 
214, 220 at a time is the master of embodiment 200. The other application program 214, 220 is thus the slave during 
that time. During that time the display of the slave is driven by the input of the master. It will be understood that data 
flows only in one direction at a time through data transmission lines 240, 242, 223, 225, 244, 246 even though they 
'5 are bidirectional. 

[0024] In some operations it may not be convenient that application programs 214, 220 of embodiment 200 should 
be the same revision and that the screens should be set up the same way. However it is these restrictions which make 
it possible to synchronize application program 21 4 and application program 220 and to perform the data sharing. When 
these restrictions can be accommodated an advantageous feature of data sharing embodiment 200 is that application 

20 programs 214, 220 may be any existing application programs. Under these circumstances application programs 214, 
220 do not have to be rewritten in order to permit data sharing between them within data sharing embodiment 200. 
[0025] Furthermore, under these circumstances applications 214, 220 may be almost any existing application. In 
order to achieve this result data sharing applications 252, 260 are adapted to control and synchronize individual ap- 
plication programs 214, 220. This is accomplished by defining the interface between applications programs 214,220 

25 and data sharing drivers 250,260. When application programs 21 4, 220 transmit data through data sharing applications 
252, 262 data sharing drivers 250, 260 are able to direct the keyboard and mouse inputs to the proper locations for 
the remote application program 214, 220. Data sharing applications are also able to issue commands to the remote 
application program 214, 220 to force it to conform to the restriction that screen set up and application set up are the 
same. In this capacity data sharing applications 252, 262 can make sure that both application programs 214, 220 are 

30 editing or modifying the same file and working on the same data. 

[0026] Thus data sharing applications 252, 262 may be tailored for an operating system rather than for each set of 
application programs 214, 220. In a windowing type of operating system data sharing applications 252, 262 may make 
system calls to the operating system and the operating system responds in a well defined way. In non-windowed 
operating systems, it is somewhat more difficult to tailor data sharing applications 252, 262 to the operating system 

35 and they would have to be more tuned to the individual application programs 214, 220. 

[0027] Referring now to Fig. 3, there is shown a block diagram representation of data sharing embodiment 300. Data 
sharing embodiment 300 may be implemented in the video conferencing system of the present invention using video 
conferencing network 324. Video conferencing network 324 couples application programs 314, 320 by way of data 
sharing drivers 350, 360 and bidirectional data transmission lines 323, 325. 

40 [0028] In data sharing embodiment 300 application programs 314, 320 are written such that they are adapted to 
share data with each other. Thus when application program 314 receives input from mouse device 328 or keyboard 
322 of remote application program 320 it is capable of processing it. Thus, in data sharing embodiment 300 both 
application programs 214, 320 are able to receive and interpret the inputs from their own keyboards 316, 322 and 
mouse devices 323, 330 as well as the inputs of the remote input devices 316, 322, 328, 330. For example, both 

45 application programs 314, 320 of data sharing embodiment 300 are able to determine whether to move an icon to a 
new location on their own screens and whether to execute a command in response to input from either keyboard 316 
322. 

[0029] Rather than transmitting raw inputs from mouse devices 328, 330 or keyboards 31 6, 322 application programs 
314, 330 send a set of commands through network 334 to remote application program 314, 330. These are application 
50 specif ic commands. 

[0030] For example, if application programs 31 4, 320 are spreadsheet programs and the user of application program 
314 highlights a specific cell in the spreadsheet display. Application program 314 transmits a command indicating the 
cell highlighting through videoconferencing network 324 to remote application program 320. This command instructs 
application program 320 to highlight the corresponding cell on its own display. Application program 314, 320 of data 
55 sharing embodiment 300 are not required to be exact by the same revision as previously set forth with respect to data 
sharing embodiment 200. Furthermore, application program 31 4, 320 are not required to provide exact the same screen 
display. Application programs 31 4, 320 are required, however, to be the same application and the data within application 
programs 314, 320 must be the same. 
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[0031] Referring now to Fig. 4, there is shown a block diagram representation of data sharing embodiment 400. Data 
sharing embodiment 400 may be implemented on the video conferencing system of the present invention. Within data 
sharing embodiment 400 application programs 414, 420 interface with video conferencing network 424 by way of 
drivers 450, 460. Application programs 414, 420 are designed to adhere to a set of application specific commands 
5 which are transmitted by way of video conferencing network 424 within data sharing embodiment 400. Application 
program 414 may be a spread sheet and application program 420 could be a document. Alternately application program 
414, 420 may be the same application program. For example application program 41 4, 420 may both be spread sheets 
or they may both be documents. 

[0032] Each application program 41 4, 420 of data sharing embodiment 400 runs its own respective shared clipboard 

io application 470, 480. In this configuration application program 414 may apply data to shared clipboard application 470 
by way of line 468 using a cut or copy command. This data is simultaneously transmitted through data sharing driver 
450 and video conferencing network 424 to data sharing driver 460, shared clipboard 480 and application program 
420. When the transmitted data is received by application program 420 it may appear at shared clipboard 480. When 
the data appears at shared clipboard 480 the user of application program 420 may issue a paste command. This 

is permits application programs 414, 420 to share information using a cut and a copy as well as a paste on the remote side. 
[0033] Thus when one application program 414, 420 transmits data by way of video conferencing network 424, the 
transmitting application 414, 420 performs a cut or copy and the other application program 414, 420 performs a paste 
operation. When the transmission arrives at the other remote application program 414, 420, it just is dropped unless 
the receiving application 414, 420 performs the paste operation. 

20 [0034] Data sharing embodiment 400 avoids the problems associated with differing revisions of application programs 
as well as other possible incompatibilities between application programs which may arise within video conferencing 
system 1 00. Examples of the possible incompatibilities which may cause problems in other data sharing arrangements 
may be the way that the display screen is set up, differing drivers, and differing versions of the operating system. Data 
sharing embodiment 400 thus allows most application programs having cut, copy and paste capabilities to perform the 

2S computer supported collaboration of the present invention. 

[0035] Referring now to Fig. 5, there is shown video conferencing embodiment 500. In video conferencing embodi- 
ment 500 video data is received by way of video input 504 and audio data is received by way of audio input 508. Data 
received by inputs 504, 508 is digitized by analog-to-digital converters 512, 516, respectively, to provide digitized video 
and analog input data streams. The digitized input data streams are applied to a compression engines 520, 524 within 

30 video conferencing embodiment 500. 

[0036] In this manner a video input signal is received at video input 504, converted to digital by analog-to-digital 
converter 51 2, and applied to video compression engine 520 and an audio input signal is received at audio input 508, 
converted to digital by analog-to-digital converter 516, and applied to audio compression engine 524. In order to permit 
embodiment 500 to provide synchronization of the compressed outputs of compression engines 520, 524, engines 

3S 520, 524 generate frames of compressed video and audio, respectively. 

[0037] The frames of video produced by video compression engine 520 may be thirty frames per second or fewer. 
The video signal which is thus divided into separate compressed frames by compression engine 520 is applied to video 
frame buffer 528 one frame at a time. The compressed audio signal is sampled and, according to both the sample 
frequency of the audio and the number of video frames per second, the compressed audio data is broken up into 

40 frames of audio by audio compression engine 524 and applied to audio frame buffer 532. 

[0038] The video frames of video frame buffer 528 and the audio frames of audio frame buffer 532 are interleaved 
by video/audio frame interleaving device 544. This process provides synchronization between the compressed video 
signals and the compressed audio signals. The frame interleaving performed by frame interleaving device 544 is a 
one-to-one interleaving of a frame of video data with a frame of audio data. 

45 [OO39] The interleaved frames of data are applied to video conferencing network 552 by way of bidirectional data 
transmission line 548 and transmitted by video conferencing network 552 to the remote side of the system. It will be 
understood by those skilled in the art that data transmission within video conferencing embodiment 500 through video 
conferencing network 524 is bidirectional and that transmission in only one direction is shown in video conferencing 
embodiment 500 in order to simplify the drawing. 

50 [0040] On the receiving side of data sharing embodiment 500 the interleaved audio and video frames from audio/ 
video frame interleaving device 544 is stored in buffer 556 wherein the interleaving audio and video frames are sepa- 
rated from each other. The separated data streams from buffer 556 are separately applied to video decompression 
engine 560 by way of line 559 and audio decompression engine 564 by way of line 563. Decompression engines 560, 
564 are effective to undo the compression of compression engines 520, 524 on the transmitting side of video confer- 

55 encing embodiment 500. 

[0041] The decompressed video data from video decompression engine 560 is applied to display device 568 for 
visual display within the receiving end of video conferencing embodiment 500. The decompressed audio data from 
audio decompression engine 564 is applied to transducer devices such as speakers 572 to provide audio reproduction. 
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These receiving and separating operations performed by buffer 566 and the receiving and decompressing operations 
of decompressing engines 560, 564, acting cooperatively with each other and with the compressing and interleaving 
operations of compression engines 520, 524, buffers 528, 532 and frame interleaving device 544, are effective to 
provide synchronization between the signals reproduced on display device 568 and speakers 572. 
[0042] The computer supported collaboration system of the present invention was implemented using known lab/ 
beta software packages such as those provided by Smart Technologies to incorporate the sharing of application pro- 
grams and their data in video conferencing using computer supported collaboration. The sharing of application pro- 
grams in this implementation, as well as the sharing of data in computer supported collaboration in general, may be 
performed by writing mouse and keyboard drivers for Microsoft Windows 3.1 to perform the operations of drivers 231 , 
232, 234, 236 in a manner understood by those skilled in the art. The characteristics of this computer supported col- 
laboration implementation are set forth in Table I. 



TABLE I 



Transfer Rate 


256k bits/sec (full duplex) 


Video Algorithm 


RTV 2.0 


Frame Rate 


Up to 12fps (b/c of inter-frame encoding) 


Video Data Rate 


Variable 


Delay (one way) 


<1 second 


Spatial Resolution 


128 x 120 


Audio Algorithm 


ADPCM4E 


Sample Rate 


8K samples/sec 


Audio Data Rate 


32K bits/sec 



[0043] A suitable operating system for providing video conferencing system 100 in this manner may be DOS 5.0. 
Programs which provide suitable windowing capability are well known in the art. They include, for example, Microsoft 
Windows SKD Windows 3.1 and AVK/Windows 1 .1 . A suitable network program f or providing, for example, the functions 
of networks 124, 224, 324, 424, 552 is available from Telsis Inc. Suitable video graphics software tor providing the 
displays of the applications programs of the computer supported collaboration of the present invention include 640x480 
VGA mode. 

[0044] The programming for windows within video conferencing system 100 or computer supported collaboration 
system 100 in the preferred embodiment is minimal. Application programs 114, 120, 214, 220, 314, 320, 414, 420 may 
open an all gray window which covers the upper half of their display devices. Two buttons may be created to provide 
operations previously described. One button may provide a telephone book dialog box and the other may hang up 
calls in order to terminate a conference. Two black rectangles may be drawn in the window for viewing images as also 
previously described. 

[0045] One window may be provided for display of the local user and the other window for display of the remote user. 
The user may select a name/number from a list of the telephone numbers and either press the CALL button to invoke 
the call, or press a cancel button. A message loop may be implemented, and if a message is not available, the com- 
munications driver is allowed to run. A timer message to this window is enabled at a rate equal to the frame rate. When 
the window receives this message it determines whether any data is ready to be sent or ready to be decompressed. 
A driver which may be used for the video/audio compression/decompression is the Audio Visual Kernal for Windows 
available from Intel Corporation. 

[0046] The setup of the audio visual kernal program can be broken up into three parts: the common setup, the 
playback setup, and the capture setup. In the common setup audio visual kernal starts by opening the audio/video 
device and registering the video teleconference window with audio visual kernal. This allows audio visual kernal to 
send messages to the window. A view may be created which maps a 256x240 bitmap onto the 640x480 videos, graph- 
ics, audio (VGA) screen. The video data may be displayed in this view and chroma keyed with the VGA display. 
[0047] In the playback setup the first thing created is a playback group. This playback group allows control of streams 
that are created in this playback group. This control may include play, pause and flush. These streams are controlled 
and synchronized as previously described. Group buffer 556 is created to hold the compressed data wherein the 
compressed data includes both the audio and video data streams interleaved as also previously described. A video 
stream and an audio stream are created within the playback group buffer and the streams are applied to their respective 
decompression engines 560, 564. A connector is created which copies and scales the decompressed video data to 
the view created in the common set up. 

[0048] In the capture setup a capture group is created. This capture group allows record, pause and flush control of 
streams that are created in this group. These streams are controlled and synchronized together. Group buffers 528, 
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532 are created, one for video input signals and one for audio input signals. Group buffers 528, 532 hold the compressed 
data. The compressed data for audio and video are stored separately in buffers 528, 532 and interleaved in video/ 
audio interleaving device 544. 

[0049] The input/output for audio visual kernal may be divided into a capture section and a playback section. The 
5 capture section is called using a polling mechanism. Captured and compressed data is read into the memory of personal 
computers 1 02, 1 04. This data movement is done for both the audio and video data streams which are already divided 
intoframes. The capture section then combines a single frame of audio with a single frame of video to create a composite 
or interleaved frame. 

[0050] The size of the frame is checked with the communications driver to see if it fits in the allocated bandwidth. If 
10 the size of the frame is too large, the capture section nulls out the video data. This involves setting the video data to 
predetermined values. These predetermined values tell the decoder to display the previous frame again. The visual 
result is a lowering of the frame rate. The composite frame header, video data, and audio data are then sent to the 
communications driver. 

[0051] The playback section is invoked by the communications driver when data is available. The playback section 
15 reads the data from the communications driver into host memory and then delivers it, as is, to the Action Media II® 
card available from Intel Corporation. 



Claims 

20 

1. Video conferencing system (500) providing computer supported collaboration between coupled computers, the 
video conferencing system comprising: 

first and second computer devices having respective first and second data, video and audio signal input means 
25 (504, 508) which are operable to generate, respectively, first and second data, video and audio signals which 

are to be received and processed at the other of said first or second computer device, 
network means (552) bidirectionally coupling said computer devices, and 

first and second application programs, respectively, on said first and second computer devices, wherein data 
signals generated at the either of said first or second computer devices are to be shared substantially simul- 
30 taneously by said first and second application programs, 

characterized by 

first and second video and audio frame buffers (528,532) and first and second interleaving means (544), wherein 
said first and second video and audio frame buffers (528,532) are adapted to accommodate video and audio signals 
35 generated at either of said first or second computer device as frames of video and audio signals and said first and 

second interleaving means (544) are adapted to interleave the frames of video and audio signals on a sequential 
one-to-one basis for transfer to the other of said first or second computer device. 

2. System of claim 1 , wherein said video and audio frame buffers (528,532) are coupled with said first and second 
40 interleaving means (544), said video and audio frame buffers (528,532) being adapted to store video and audio 

signals, respectively. 

3. System of claim 1, wherein said first and second application programs are identical and of the same revision. 

45 4. System of claim 1 , wherein said first and second application programs are adapted to generate first and second 
application signals from input signals generated by one of a first and second keyboard and mouse driver, said first 
and second application programs being configured to share said first and second application signals, wherein said 
system further comprises first and second application signal sharing means enabling sharing of said application 
signals from one of said first or second application program with the other of said first or second application program. 

so 

5. System according to claim 4 : wherein said first and second application programs are adapted to substantially 
simultaneously operate on a same file using identical application signals under control of said first and second 
application signal sharing means. 

55 6. System according to claim 4, wherein said first and second application programs are different revisions of a same 
program. 

7. System of claim 4, wherein said first and second application programs have cut copy and paste capabilities and 
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further comprising first and second shared clipboard memory means associated with said first and second computer 
devices, respectively, wherein application data signals from one of said first or second application programs is 
input to the other of said first or second shared clipboard memory means. 

8. Video conferencing device being adapted to be implemented in a video conferencing system (500) providing com- 
puter supported collaboration between coupled computers, said device comprising: 

a computer device having data, video and audio signal input means (504, 50B) which are operable to generate, 
respectively, data, video and audio signals, and 

an application program being localized on said computer device, wherein data signals generated at said com- 
puter device are to be shared by said application program, 

characterized by 

a video frame buffer (528) and an audio frame buffer (532) and an interleaving means (544) wherein said video 
and audio frame buffers (528,532) are adapted to accommodate video and audio signals at said computer device 
as frames of video and audio signals and said interleaving means (544) are adapted to interleave the frames of 
video and audio signals on a sequential one-to-one basis for transfer to another computer device in said video 
conferencing system. 

9. Device of claim 8, wherein said computer device is coupled with a network means (552). 

10. Method for video conferencing using a first computer device coupled to a second computer device via network 
means being operable to bidirectionally couple said computer devices, said method comprising the steps of: 

transmitting data, video and audio signals from said first computer device to said second computer device, and 
substantially simultaneously receiving and processing data, video and audio signals at said first computer 
device transmitted from said second computer device, 

characterized by the steps ol 

storing said video and audio signals prior to the step of interleaving, and 

interleaving video and audio signals on a sequential one-to-one basis before transmitting said video and audio 
signals to said second computer device. 

11. Method of claim 10, further comprising the step of running an application program on said first computer device 
for generating application data signals from input signals generated by one of a keyboard or mouse driver, said 
application programs being configured to share said application data signals, said application data signals com- 
prising said data signals. 

Patentanspruche 

1. Videokonferenzsystem (500) fur computergestutzte Zusammenarbeit zwischen gekoppelten Computern, wobei 
das Videokonferenzsystem aufweist: 

erste und zweite Computereinheiten mit jeweils ersten und zweiten Daten-, Video- und Tonsignal-Eingangs- 
schaltungen (504,508), welche betreibbar sind zur Erzeugung jeweils erster und zweiter Daten-, Video- und 
Audio-signale, die vom jeweils anderen der jeweils ersten oder zweiten Computereinheit zu empfangen und 
zu verarbeiten sind, 

ein Netzwerk (552) zur bidirektionalen Kopplung der Computereinheiten, und 

erste bzw. zweite Anwenderprogramme auf der ersten bzw. zweiten Computereinheit, wobei von einer der 
beiden Computereinheiten erzeugte Datensignale im wesentlichen gleichzeitig zwischen den ersten und zwei- 
ten Anwenderprogrammen aufzuteilen sind, 

gekennzeichnet durch 

ersten und zweite Video- und Audio-Rahmenpuffer (528,532) und eine erste und zweite Verschachtelungsstufe 
(544), wobei die ersten und zweiten Video- und Audio-Rahmenpuffer (528,532) geeignet sind, Video- und Audio- 
signale, die von einer der beiden Computereinheiten erzeugt worden sind, als Rahmen von Video- und Audiosi- 
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gnalen zu verwenden und die erste und zweite Verschachtelungsstufe (544) geeignet ist, die Rahmen der Video- 
und Audiosignale sequentiell auf einer Eins-zu-E ins-Basis zur Ubertragung zu der jeweils anderen Computerein- 
heit zu verschachteln. 

2. System nach Anspruch 1 , bei welchem die Video- und Audio- Rah men puffer (528,532) mit der ersten und zweiten 
Verschachtelungsstufe (544) gekoppelt sind und die Video- und Audio-Rahmenpuffer (528 : 532) geeignet sind zur 
Speicherung von Video- bzw. Audiosignalen. 

3. System nach Anspruch 1 , bei welchem das erste und zweite Anwenderprogramm identisch und von gleicher Uber- 
arbeitung sind. 

4. System nach Anspruch 1 , bei welchem das erste und das zweite Anwenderprogramm geeignet sind, erste und 
zweite Anwendersignale aus den Eingangssignalen zu erzeugen, welche von einem ersten Oder zweiten Key- 
board- und Maustreiber erzeugt sind, und das erste und zweite Anwenderprogramm zur Aufteilung der ersten und 
zweiten Anwendersignale konfiguriert sind, und wobei das System ferner eine Aufteilungseinheit fur die ersten 
und zweiten Anwendersignale aufweist, die eine Aufteilung der Anwendersignale von einem der beiden Anwen- 
derprogramme mit dem jeweils anderen Anwenderprogramm erlaubt. 

5. System nach Anspruch 4, bei welchem die ersten und zweiten Anwenderprogramme geeignet sind, im wesentli- 
chen gleichzeitig auf derselben Datei zu arbeiten unter Verwendung identischer Anwendersignale unter Steuerung 
durch die Aufteilungseinheit fur die ersten und zweiten Anwendersignale. 

6. System nach Anspruch 4, bei welchem das erste und zweite Anwenderprogramm unterschiedliche Uberarbeitun- 
gen eines gleichen Programms sind. 

7. System nach Anspruch 4, bei welchem die ersten und zweiten Anwenderprogramme ein Schneiden, Kopieren und 
Zusammenfugen erlauben, und weiterhin enthaltend erste und zweite gemeinsam aufgeteilte Clipboard-Speicher, 
die der ersten bzw. zweiten Computereinheit zugeordnet sind, wobei die Anwenderdatensignale von einem der 
beiden Anwenderprogramme als Eingangssignale auf den jeweils anderen der beiden aufgeteilten Clipboard-Spei- 
cher gegeben werden. 

8. Videokonferenzeinrichtung, die sich zur Implementierung in einem Videokonferenzsystem (500) eignet, bei dem 
eine computergestutzte Zusammenarbeit zwischen gekoppelten Computern vorgesehen ist, wobei die Einrichtung 
aufweist: 

eine Computereinheit mit einer Daten-, Video- und Audio-Signaleingangsschaltung (504,508), welche geeig- 
net ist, jeweilige Daten-, Video- und Audiosignale zu erzeugen, und 

ein auf der Computereinheit vorgesehenes Anwenderprogramm, bei welchem Datensignale von der Compu- 
tereinheit erzeugt werden, in welche sich das Anwendungsprogramm teilt, 

gekennzeichnet durch 

einen Video-Rahmenpuffer (528) und einen Audio-Rahmenpuffer (532) und eine Verschachtelungsstufe (544), 
wobei die Video- und Audio-Rahmenpuffer (528,532) geeignet sind, Video- und Audiosignale an der Computer- 
einheit als Rahmen von Video- und Audiosignalen zu verwenden, und die Verschachtelungsstufe (544) geeignet 
ist, die Rahmen von Video- und Audiosignalen sequentiell auf einer Eins-zu-E ins-Basis zu verschachteln zur Uber- 
tragung zu einer anderen Computereinheit in dem Videokonferenzsystem. 

9. Einrichtung nach Anspruch 9, bei welcher die Computereinheit mit einem Netzwerk (552) gekoppelt ist. 

10. Verfahren zur Durchfuhrung einer Videokonferenz unter Verwendung einer ersten Computereinheit, die mit einer 
zweiten Computereinheit uber ein Netzwerk gekoppelt ist, welches im Betrieb die Computereinheiten in beiden 
Richtungen miteinander koppelt, mit den folgenden Schritten: 

Senden von Daten-, Video- und Audiosignalen von der ersten Computereinheit zur zweiten Computereinheit 
und 

im wesentlichen gleichzeitiges Empfangen und Verarbeiten der von der zweiten Computereinheit empfange- 
nen Daten-, Video- und Audiosignale an der ersten Computereinheit, 
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gekennzeichnet durch die Schritte: 

Speichern der Video- und Audio-Signale vor dem SchriU der Verschachtelung und 

Verschachteln der Video- und Audiosignale auf sequentieller Eins-zu-Eins-Basis vor dem Senden der Video- 
und Audiosignale an die zweite Computereinheit. 

11. Verfahren nach Anspruch 10 mit dem weiteren Schritt des Laufens eines Anwenderprogrammes auf der ersten 
Computereinheit zur Erzeugung von Anwenderdatensignalen aus den vom Keyboard- oder Maustreiber erzeugten 
Eingangssignalen, wobei die Anwenderprogramme konfiguriert sind, urn sich die Anwenderdatensignale zu teilen, 
und die Anwenderdatensignale die Datensignale enthalten. 



Revendi cat ions 

1. Systeme de visioconference (500) prevoyant une collaboration supportee par ordinateurs entre des ordinateurs 
couples, te systeme de visioconference comprenant : 

des premier et second dispositifs informatiques comportant des premiers et seconds moyens d'entree de 
signaux de donnees video et audio (504, 508), pouvant etre actionnes de maniere a produire respectivement 
des premiers et seconds signaux de donnees video et audio qui sont destines a etre recus et traites au niveau 
de I'autre dispositif desdits premier et second dispositifs informatiques, 

des moyens de reseau (552) couplant de facon bidirectionnelle lesdits dispositifs informatiques, et 
des premier et second programmes d'application, situes respectivement sur lesdits premier et second dispo- 
sitifs informatiques, ou les signaux de donnees produits au niveau de Tun ou I'autre desdits premier et second 
dispositifs informatiques sont destines a etre partages sensiblement simuftanement par lesdits premier et 
second programmes d'application, 

caracterise par des premier et second tampons de trame video et audio (528, 532) et des premiers et seconds 
moyens d'entrelacage (544), dans lequel lesdits premier et second tampons de trame video et audio (528, 532) 
sont adaptes pour recevoir des signaux video et audio produits au niveau de Tun ou I'autre desdits premier et 
second dispositifs informatiques en tant que trames de signaux video et audio et lesdits premiers et seconds 
moyens d'entrelacage (544) sont adaptes pour entrelacer les trames de signaux video et audio, un par un de facon 
sequentielle, pour un transfer! vers I'autre desdits premier et second dispositifs informatiques. 

2. Systeme selon la revendication 1 , dans lequel lesdits tampons de trame video et audio (528, 532) sont couples 
auxdits premiers et seconds moyens d'entrelacage (544), lesdits tampons de trame video et audio (528, 532) etant 
adaptes pour memoriser respectivement des signaux video et audio. 

3. Systeme selon la revendication t , dans lequel lesdits premier et second programmes d'application sont identiques 
et de la meme version. 

4. Systeme selon la revendication 1 , dans lequel lesdits premier et second programmes d'application sont adaptes 
pour produire des premier et second signaux d'application a partir de signaux d'entree produits par un element 
parmi un premier et un second pilotes de clavier et de souris, lesdits premier et second programmes d'application 
etant configures de maniere a partager lesdits premier et second signaux d'application, dans lequel ledit systeme 
comprend en outre des premiers et seconds moyens de partage de signaux d'application permettant de partager 
lesdits signaux d'application provenant d'un programme parmi lesdits premier et second programmes d'application 
avec I'autre desdits premier et second programmes d'application. 

5. Systeme selon la revendication 4, dans lequel lesdits premier et second programmes d'application sont adaptes 
pour fonctionner sensiblement sur un meme fichier en utilisant des signaux d'application identiques sous le controle 
desdits premiers et seconds moyens de partage de signaux d'application. 

6. Systeme selon la revendication 4, dans lequel lesdits premier et second programmes d'application sont des ver- 
sions differentes d'un meme programme, 

7. Systeme selon la revendication 4, dans lequel lesdits premier et second programmes d'application ont des pos- 
sibles de coupage, copie et collage et comprennent en outre des premiers et seconds moyens de memoire 
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partagee presse-papiers associes respectivement auxdits premier et second dispositifs informatiques, dans lequel 
les signaux de donnees d'application provenant d'un programme parmi lesdits premier et second programmes 
d'application sont appliques a I'entree de I'autre desdits premier et second dispositifs de memoire partagee presse- 
papiers. 

Dispositif de visioconference adapte pour etre mis en oeuvre dans un systeme de visioconference (500) prevoyant 
une collaboration supportee par ordinateurs entre des ordinateurs couples, ledit dispositif comprenant : 

un dispositif informatique comportant des moyens d'entree de signaux de donnees video et audio (504, 508), 
pouvant etre actionnes de maniere a produire respectivement des signaux de donnees video et audio, et 
un programme d'application, localise sur ledit dispositif informatique, ou les signaux de donnees produits au 
niveau dudit dispositif informatique sont destines a etre partages par ledit programme d'application, caracterise 
par un tampon de trame video (528) et un tampon de trame audio (532) et des moyens d'entrelacage (544), 
dans lequel lesdits tampons de trame video et audio (528, 532) sont adaptes pour recevoir des signaux video 
et audio au niveau dudit dispositif informatique en tant que trames de signaux video et audio et lesdits moyens 
d'entrelacage (544) sont adaptes pour entrelacer les trames de signaux video et audio, un par un de facon 
sequentielle, pour transfert vers un autre dispositif informatique dudit systeme de visioconference. 

Dispositif selon la revendication 8, dans lequel ledit dispositif informatique est couple a des moyens de reseau 
(552). 

Procede de visioconference utilisant un premier dispositif informatique couple a un second dispositif informatique 
par I'intermediaire de moyens de reseau pouvant etre actionnes pour coupler de facon bidirectionnelle lesdits 
dispositifs informatiques, ledit procede comprenant les etapes consistant a transmettre des signaux de donnees 
video et audio dudit premier dispositif informatique audit second dispositif informatique, et recevoir et traiter sen- 
siblement simultanement les signaux de donnees video et audio au niveau dudit premier dispositif informatique, 
transmis par ledit second dispositif informatique, caracterise par les etapes consistant a : 

memoriser lesdits signaux video et audio avant I'etape d'entrelacage, et 

entrelacer les signaux video et audio, un par un de facon sequentielle, avant de transmettre lesdits signaux 
video et audio audit second dispositif informatique. 

Procede selon la revendication 10, comprenant en outre I'etape consistant a executer un programme d'application 
sur ledit premier dispositif informatique pour produire des signaux de donnees d'application a partir de signaux 
d'entree produits par un element parmi un premier et un second pilotes de clavier et de souris, lesdits programmes 
d'application etant configures de maniere a partager lesdits signaux de donnees d'application, lesdits signaux de 
donnees d'application comprenant lesdits signaux de donnees. 
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